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ABSTRACT 

This paper is concerned with the issue of how verbal instructions influence skill 
learning. In particular, our goal Is to outline the components of initial cognitive skill 
acquisition and analyze what features of elaborations in the instructional materials 
can facilitate each component. We identify three basic components of skill 
learning: learning novel concepts and the functionality of novol concepts and 
procedures; learning how to execute the procedures; and learning the conditions 
under which the procedures can and should be applied. Each of these 
components can be learned Independently and each component can be a 
'bottleneck* to acquiring a skill. 

Three types of elaborations are analyzed in terms of the requirements of these 
components: analogies, simple Instantiations, and situation examples. We argue 
that situation examples are the m:jt useful type of elaboration for skill learning 
because each example can contribute to learning in all three components. On the 
other hand, while, analogies can be constructed to illustrate each component, they 
are more likely to help people learn the functionality of a procedure. than how to 
execute it or when to select it. However, since learners tend to rely on examples 
as models, it Is very important to choose examples with great care and to provide 
enough examples to illustrate the range of application of a rule or procedure. 
Otherwise, learners may interpret a rule incorrectly or make spurious assumptions 
about the conditions under which it applies. 
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1. Introduction: Skill Learning and Theories of Cognition 

Understanding the processes by which people learn Is fundamental to any theory of 
cognition. Accounting for learning adds constraints to theories of cognition; not only must a 
theory account for adult capacities, but it must also posit mechanisms for acquiring new 
capabilities as adult learners do. Although the study of how information is acquired has 
been central in memory research, only a few theories of cognition, problem solving and the 
like (e.g., Anderson, 1983; Kieras & Poison, 1985; Hayes & Simon, 1974) have been 
concerned with specifying how a skill or procedure is initially acquired. 

It seems natural and desirable to try to apply what we have discovered about acquiring 
factual information to the study of how people learn new skills or procedures. However, while 
the findings from the memory domain are certainly relevant to the study of skill acquisition, 
they fail short of what is needed. At the very least, the standard performance measures for 
fact learning (e.g., recognition judgments, binary-choice decision tasks and recall protocols) 
are inappropriate for measuring skill learning, which requires the learner to apply his or her 
knowledge. Consider a budding scientist who has studied inferential statistics in order to 
determine the reliability of experimental results. A fair test of how well this student has 
learned the various statistical tests is not whether she can recall their formulae, but rather 
whether she can select the appropriate test and use It correctly to analyze the data. 
Presented with two samples to contrast, the student must remember that there is a test 
called the Student Mest and decide that it is an appropriate test for the data at hand. 
Then she must retrieve the formula for the test, find and plug in values for the variables in 
the formula correctly, and solve for the correct result. 1 

This example Illustrates that although skill learning and fact learning both involve the 



Remembering that the name of the teat is •Heat" la not critical In this caae, but In other skill taaka (auoh 
aa ualng a computer or constructing a proof), remembering the name of a procedure can be quite Important. 
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acquisition of new information, they differ in the types of information that must be learned 
and the ways in which the learner uses the information. The first obvious difference between 
fact learning and skill learning is that a skill has an execution component that is quite 
specific to that skill and the requirements for execution vary considerably from skill to skill. 
The output for many skills comes in the form of complex motor activity, such as pressing a 
certain sequence of keys or fitting together the parts of a device. In contrast, the output 
modes for demonstrating mastery of a fact are general, simple and well-learned: the learner 
vocalizes or writes the fact that is retrieved from memory or signals whether the retrieved 
representation meets some criterion (e.g., recognition or paraphrase match). 

One reason for the variation id that skills are often built up out of component skills, 
which are called on in the manner of 'subroutines/ For example, performing a Meet 
involves at least two component skills: finding the mean and the standard error of a 
sample. A different procedure might involve finding a different mean, bin using some of the 
same values to determine the error term. The relationship between facts in a domain 
seems qualitatively different from the relationship between subroutines embedded in a 
procedure. While it is common to "unpack* a concept by retrieving related concepts, the 
process is seldom as routine and unvarying as performing a fixed subroutine. 

Another difference between skill learning and fact learning is that the context in which a 
fact is retrieved can facilitate access to the learned information. A learner demonstrates fact 
learning by retrieving a fact in response to a query. The query not only provides a retrieval 
cue, but It also provides an appropriate occasion for retrieving that particular fact. In other 
words, a person can be considered to have mastered a fact If he or she can recall it when 
specifically queried. But recall of procedures when queried is not sufficient for mastery of a 
skill. Knowing how to perform a skill requires that the learner understand and appreciate 
the contexts in which a particular procedure is appropriate. In the case given above, 
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deciding to use the Meet rather than some other test depends on knowing something about 
the function of the west and something about the data to be analyzed* Granted, it is just 
as important to know when to use a fact as when to use a procedure. The difference is, 
however, that learning a skill means knowing when to use the acquired procedures but 
learning a fact does not* A test of skill learning should mearure the learner's ability to 
choose procedures appropriately* 

In addition to differences in what must be learned, there are also differences in how we - 
view "mastery" of a fact versus a skill* Although facts can vary in leamability and strength, 
we usually do not judge "how well" a fact is recalled when it is recalled* In constrast, 
procedures not only vary in ease of learning, but most require practice for any degree of 
competence to be attained* That is why in skill domains, we classify practitioners as 
experts, novices or intermediates* We do not say that sorfieone is "skilled" in a particular 
domain until she can execute the procedures rapidly and rather effortlessly. A person who 
is slow to execute basic procedures or who rehearses the requisite steps "declaratlvely" is 
usually judged to be a novice* 

Because skill learning involves different output requirements and different standards for 
proficiency, we need new, more sensitive measures in order to study skill learning. But, 
more importantly, we need to consider closely the cognitive mechanisms of skill learning and 
how they interact with those of fact learning. If skill learning draws heavily on declarative 
knowledge, then we might expect factors that affect encoding, retention and retrieval from 
declarative memory to be important for skill learning* (Conversely, if skill learning and fact 
learning involve largely independent processes, then we might not expect conditions that 
facilitate fact learning to have much benefit for skill learning* 

One model of cognition that carefully considers where declarative knowledge interacts 
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with procedural knowledge is Anderson's (1983) ACT* model. Anderson foiiows Fitts (1964) 
in positing that learners initially acquire a skill In declarative form, usually from oral or 
written instructions. Procedural knowledge of the skill, in the form of a production system, 
arises only after hands-on practice. At first, in order to approximate the required skill 
behavior, the learner uses a set of general-purpose productions to retrieve segments of the 
declarative representation of the instructions, and translate them into a series of actions. 
With additional practice, the learner gradually constructs a set of skill-specific productions 
that directly incorporate the relevant declarative knowledge, eliminating the extra step of 
retrieving this information from declarative memory. As the productions are complied and 
tuned, skill performance fmproves dramatically; performance becomes much more efficient 
and requires much less conscious attention. 

in this model, declarative knowledge becomes increasingly superfluous to skill 
performance as learners gain expertise, but the declarative representation is critical to the 
Initial stages of skill learning. . We might expect, then, that factors influencing the formation 
of the declarative representation would strongly influence initial skill performance, in 
particular, the form of the verbal instructions on which the declarative representation is 
based is clearly quite important, if the learner cannot extract an adequate declarative 
representation of what to do from the instructions, it unlikely that ho or she will be able 
to approximate the skill, except perhaps through trlal-and-error or some other problem-solving 
heuristic. Further, since the initial productions are based on the learner's early 
approximations of the skill performance, the form of the verbal instructions may critically 
Influence what the sklii-specific productions look like. Surprisingly, the issue of how verbal 
instructions influence the initial acquisition of procedures is only beginning to receive 
attention in the literature (e.g., Lefevre, 1985; Weras & Poison, 1985; Hayes & Simon, 1979). 

This paper, then, is concerned with the initial stage of cognitive skill acquisition; that is, 
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how a novice learns a skill well enough to use It. We mean to distinguish this stage, in 
which the learner acquires the bare essentials of a cognitive skill, from later stages in which 
the learner becomes proficient. Theories concerned with proficiency (e.g., the dynamics of 
speed-up with practice) have been developed by a number of researchers (e.g., Anderson, 
1982; Newell & Rosenbioom, 1981; Rosenbioom & Newell, in press; Schneider & Shiffrin, 
1977; Shiffrin & Dumais, 1981; Shiffrin & Schneider, 1977). Rather than trying to understand 
the development of cognitive expertise, our goal is to explore more carefully the requisite 
components of initial cognitive skill acquisition and what features of the initial verbal 
lnstruu!on facilitate each component. 

We will begin by outlining three components that we consider crucial for initial skill 
learning. Then we wii! describe three types of elaborations that we bilieve facilitate learning 
and Illustrate the ways in which they facilitate the components of skill learning. Finally, we 
will summarize our- view as to where elaborations are beneficial and where they are not. 

2. A Tri-Partite Model of Cognitive Skill Acquisition 

We conceive of initial skill learning as consisting of three critical components: 

* learning novc concepts and the functionality of novel procedures; 

* learning how to execute the procedures; 

* learning the conditions under which a procedure Is applied; and remembering the 
best procedure to execute in a given situation. 

In other words, learning a skill means knowing what procedures exist for accomplishing 
various goals, knowing how to carry out the procedures, and knowing under what 
circumstances to apply them (including remembering to use them when the situation 
warrants). Each of these components can be learned independently and each component 
can bo a "bottleneck* to acquiring a skill. Furthermore, the relative importance of the 
components may vary, depending on the type of skill being learned: assembling a piece of 
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equipment, operating a device, using a computer cystem, solving problems. This section will 
consider the requirements of each component in more detail. 

2.1. ^earning Novel Concepts and the Functionality of Procedures 

For someone learning an entirely new skill, the idea of what kinds of things can be 
accomplished and what objects the procedures act on may be entirety unfamiliar. Consider 
someone who is learning to use a computer text-editor (e.g., EMAJS) for the first time. A 
proficient typist who has never used a word-proceasor will consider it a novel concept to 
insert a word into a string lnstc?d of erasing a line and retyping it. Features such as 
automatic line wrapping, multiple windows into the same file, keyboard macros and kill 
buffers are other concepts that will be entirely new. n addition to novel concepts such as 
these, the novice user must also find out what things can an4 cannot be dene with a text- 
editor. That is, the learner needs to know what distinct procedures (In this case, what 
commands) are available in the text-editing system and understand what ee.ch one does. 

It Is important to distinguish between* learning a procedure's functionality and acquiring a 
"mental model* of the system that usos these procedures. Learning the concepts and the 
function of individual procedures does not entail acquiring a mental model of a system (i.e., 
its components and how they interact). Although a sophisticated understanding of the 
concepts and procedures may involve the construction of a mental model, a mental model is 
not always necessary for proficient skill performance. For example, many experienced drivers 
have little more than a crude Idea of how a car works. The value of a mental model to 
the novice learner depends on the type of skill being learned. As Weras (198S) points out, a 
mental model of how a device works Is only likely to improve performance !f the procedures 
for operating or assembling the device can be inferred from knowing how the parts interact. 
In a computer operating system, the syntax and the names of commands are oftentimes 

chosen arbitrarily, so having a mental model of how a computer works is not likely to help 

* 
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people ieam and remember how to execute the commands. On the other hand, when the 
goal Is to trouble-shoot the system, having a mental model can be very helpful. That is, 
when the computer is not responding in the expected way, it is much easier to diagnose 
the trouble If one has a mental model of what the computer does under various 
circumstances. 

2.2. Learning How to Execute New Procedures 

It Is often crucial In skill learning to remember fairly arbitrary associations of objects and 
functions (e.g., which button on a control panei produces the desired state) and to be able 
to reproduce exact sequences of symbols and actions, in this respect, skill learning is quite 
different from fact leaning. When seeking declarative information, people are usually highly 
tolerant of gist reporting, paraphrasing and even slips of the tongue. It is irrelevant for 
most purposes whether a fact presented In one syntactic form (e.g., passive) Is stored or 
retrieved In another (e.g., active), in contrast, there Is low tolerance for such variation in 
most cognitive skill domains. For example, computers cannot commonly recognize a wide 
range of synonyms or abbreviations of crucial terms. In fact, computers are notoriously 
"literal-mind^ when a user presses the wrong key, the computer at best responds with an 
error message, and at worst performs an undeslred action. The computer has little or no 
capacity to Infer what key the user intended, even if the key he typed had a similar label or 
was physically near the correct key. Given the current technology, learners must strictly 
adhere to the vocabulary and syntactic rules of whatever system, language or program they 
are using. Equally strict conditions o^ the sequence of operations and the use of symbols 
are imposed in many non-computer skill domains. 

The complexity of the execution component depends on the nature of the procedure and 
the skill domain itself. In many domains, the task r»* leg. fling to execute a procedure 
consists of learning three elements: 
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* the name of the procedure, 

* the rule describing a sequence of operations, and 

* the method of binding variables in the rule to objects in that problem space. 

These three elements can be illustrated most clearly in the case of computer commands. 
Suppose that a learner Is given the task of renaming a file. To execute the procedure the 
learner must first remember the na^ie of the command (e.g., RENAME). Then he must 
reproduce the sequence c # arguments that the RENAME command requires (e.g, type the 
name of the command, then the current name of the file, then the desired name cf the 
file). In this sequence, the name of the command (RENAME) is a constant term, but the 
present and desired names are varie' 'es. The leamor must determine the values of these 
variables for the present situation, and plug the values into the correct places in the 
sequence. 

The first and third elements, learning the name of a procedure and learning to bind 
variables, are not required in all skills. They are most often required in skills like using a 
computer that involve a set of general, multipurpose procedures. Whereas the procedures 
In a k jmputer manual can be used over and over in novel combinations to accomplish a 
wide variety *>f goais, the goal is fairly fixed in an assembly task or a device operation task. 
For example, when one Is learning to put together a stereo phonograph system, there is a 
specific, known object that a closed set of pieces Is going to form. In this case, the 
descriptions of the procedures can be completely explicit, naming the exact parts that are 
involved at each stage. Each step in the assembly Is performed only once. Under these 
circumstances, there are no variables and the procedures need not be named. 

The second element, the rule or sequence of operations, can take many different forms. 
Commonly, the sequence of operations comes in the form of an ordered list such as a 
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cookbook recipe, each step of which may refer to distinct subprocesses (e.g., sauteeing 
vegetables as part of a recipe for making spaghetti sauce). However, a list format is not 
appropriate to ail skills. Mathematical formulas and computer commands have a formal 
syntax which may be expressed abstractly in the form of a rule or template. To Illustrate 
the diversity of these abstract rules, we provide three examples below. The first is a 
formula for the Mast for single mean (compared to a specified constant). The second Is the 
syntactic rule for the command to rename files on the IBM-PC. The third is a template for 
defining functions in the computer language LISP: 2 

U) 




where s is an estimate of the population standard deviation.. 

RENJAME] \d:\\path\niename{.exti filename{.ext\ (2) 

(DEFUN <functk>n name> (3) 
. (<parameter 1> <parameter 2> ... <parameter n>) 
< process description >) 

To execute the procedures for the Mest, one finds values for ail of . the variables 
mentioned in the rule, performs the arithmetic calculations signalled by the mathematical 
symbols and solves for a numeric solution. This procedure is quite different from the use 
of a syntactic rule or template. The sequence of operations for generating a RENAME 
command or defining a (JSP function from a template is to type a sequence of symbols 
that matches the template in structure, in which each constant term (e.g., DEFUN) and each 
symbol (e.g., parentheses, colons, spaces) appears in the appropriate location and each 
variable Is replaced by the appropriate value. 

The degree to which the rule for a procedure must be internalized depends on the task. 



'The rule for the rename command was taken from the official Disk Operating System (DOS) manual 
(Anonymous, 1983). The USP template Is taken from Winston and Horn (1981). 
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For many skills, executing the procedures should be automatic. For example, once learners 
know how to use a computer text editor, they use the manual mainly to learn new features 
or to solve some unexpected problem or for an occasional reminder. They should not have 
any difficulty executing the standard set of commands without much conscious attention. On 
the other hand, factors such as the number and complexity of the procedures, their 
importance or their frequency of use may require learners to depend on written instructions 
each time they perform a task. For example, airplane pilots review printed check-lists each 
time they fly. 

2.3. Learning Conditions for Application 

As argued above, having a skill means knowing when to apply particular procedures, in 
some cases, the conditions for application are perfectly straightforward. For example, when 
the procedures come in a strictly ordered sequence, the precondition for any given 
procedure is the result of correctly executing the previous procedure. The conditions for 
application may be much more complex, however, in skills such as using a computer, there 
may be multiple ways to accomplish a goal. Under certain conditions, one procedure might 
be much more efficient or advantageous than the rest, if novices don't appreciate the 
conditions under which the procedures are most useful, they might overlook procedures that 
would be very useful to them. Instead, they might always choose to use some inefficient 
procedure that they happened to learn first or that may initially be easier to remember. 

Card, Moran and Neweil's (1983) study of experienced users of a text-editing system 
demonstrated that experts have well-defined rules for selecting between procedures. The text 
editor involved offered two basic methods of moving the cursor: searching for a specified 
string of characters or moving the cursor up or down a line at a time. The subjects had 
consistent strategies for for choosing between these methods (e.g., use the search rcsthod if 
the target location is more than three lines away, use the line-feed method otherwise). 
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Presumably, these computer users developed their strategies themselves, but their early 
learning was not observed. At least some of the subjects had developed fairly inefficient 
strategies. For example, one subject never used the string search method; she used some 
variation of the line-feed method even when the target location was over 10 lines away. 3 

if we wish learners to use a repertoire of procedures appropriately, It may be necessary 
to motivate the use of some procedures by demonstrating the advantages they have In 
particular situations. Acquiring a repertoire goes beyond the ability to decide between 
specified procedures on demand. Even if a person can, when queried, consistently judge 
which of two procedures is more efficient in a given context, he may not always select the 
most efficient one in real situations. The learner may fall to ask (or je unwilling to ask) for 
each subgoal, ""which procedure is optimal here?* Computing the relative costs of 
procedures can be time consuming and tedious, and not without Its share of the costs. 
Therefore, unless a procedure easily "comes th mind,* it may remain unused. This means 
that skilled performance involves not only the ability to recognize the situations In which a 
given procedure Is optimal, but the ability to retrieve the best procedure easily and rapidly 
when necessary. 

It Is worth noting that learning sophisticated selection strategies is probably unnecessary 
for skill tasks such as learning to assemble a device or operate a piece of equipment. 
Since the procedures In these tasks are less multipurpose, they are also less 
Interchangeable, h is more likely that the conditions for application in these tasks grow out 
of ordering constraints rather than considerations of efficiency. 



J Card, Moran and Newell successfully modelled how the experts used selection rules, but they weren't 
Interested In the relative efficiency of the rules their subjects had come up with nor in how the subjects had 
acquired their rules. 
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2.4. The Independence of the Three Components of Skill Learning 

The three components of skill learning that have just been described are fairly 

Independent of one another. A learner may know that a specific procedure exists for 

solving a problem without knowing or remembering how to apply It. For example, a child 

knows what shoe-tying is and when it needs to be done, but lacks the ability to carry out 

the procedure. Simflariy, by rote-learning, one n,ay learn to perform a series of steps 

without knowing what the steps are for. Finally, one may understand what a procedure does 

and how to carry I out, but not know when or why to use This situation often arises 

when novices consult computer manuals: they finish reading a description of a command, 

understand more or less what it does and how to issue it, but lack the slightest inkling as 

to when they would ever want to use It or how it relates to other commands they have 

learned. Since each of the three components Is necessary to skil! learning, each can 

constitute a 'bottleneck* for acquiring a skill. 

i 

3. Three Types of Elaborations for Facilitating Skill Learning 

The question we address in the remainder of this chapter Is how the presentation of 
information in an Instructional text can facilitate learning In the three components just 
described. We will focus on a particular aspect or instructional texts, namely the degree to 
which the main points are elaborated. 

The effect of elaborations on the acquisition of Information from a text has been the 
topic of considerable speculation and research (Reder, Charney, & Morgan, in press; 
Anderson & Reder, 1979; Reder, 1976; Reder, 1979; Welnstein, 1978; Mandi & Bailstaedt, 
1981; M Schnotz & Tergan, 1984; Bransford, 1979; Chiesi, Splllch & Voss, 1979; Craik 
& TuMng, 1975; Reder, in press). In the view of most researchers, there are several 
reasons why elaborations should help subjects learn and remember the main ideas o'i a text. 
Elaborations provide multiple retrieval routes to the essential Information by creating more 
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connections to the learner's prior knowledge. If one set of connections is forgotten, it may 
be possible to retrieve the desired information another way. Further, if the learner forgets 
an important point, it may be possible to reconstruct it from the information that is still 
available. Not all the evidence on elaborations is positive, however. Reder and Anderson 
(1980; 1982) found that elaborations can impair learning and retention of the main points of 
a textbook chapter as compared to studying a brief summary of the main points. In 
contrast, Reder, Charney and Morgan (in press) found that when the goal is to use the 
information in a skill learning task, elaborations can improve performance. 

This section defines the. essential characteristics of three types of elaborations that we 
think are especially important for skill learning: analogies and two types of examples (simple 
instantiations and situation examples). After these types of elaborations are defined, the 
next section will 'escribe how they may specifically contribute to skill learning. 

3.1. Analogy . 

An analogy draws a comparison between a con<x> that a person wants to leam and a 
concept In a different domain that the learner is already familiar with. In Gentner's (1983) 
terminology, the former is the 'target concept* and the latter is the 'base concept/ 
Gentner proposes that the quality of an analogy depends on what type of information can 
be mapped from the base to the target construct. Good analogies map across relationships 
between objects rather than specific attributes of objects. For example, In the familiar 
analogy between the solar system and t^e structure of the atom, the attributes of the sun 
(HOT and YELLOW) are not mapped to the nucleus of the atom. What Is mapped is the 
relationship of the cun to the planets (I.e., the sun is MORE MASSIVE THAN the planets 
and the planets REVOLVE AROUND the sun). 

We suspect that analogies reduce the processing load during learning by facilitating 
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chunking of the information in the target domain. That is, the structure of concepts and 
relations from the base domain can be used to provide temporary labels on components of 
the target idea while the problem or task is being solved. Since the base labels are well 
understood, the pointers to the relevant structure(s) in memory are not lost while the learner 
works through the critical new aspects of the target domain. 

3.2. Exemplification 

Like analogy, exemplification involves a mapping between two concepts, but the mapping 
is more tightly constrained. We will follow Hobbs (1978) in defining exemplification as a 
relationship between a rule (or generalization) and a specific instance (or example) for which 
the rule holds true. The rule and the example are related by sharina the tome underlying 
proposition. In other words, the relationships between objects in the general construct must 
map across to the specific construct. Unlike analogy, however, exemplification also 
constrains the mappings of object attributes. The objects in a rule are abstract, general 
categories. The objects in an example are more specific members of those general 
categories. That is, an example can be constructed by substituting one or more specific, 
concrete terms for general terms in a rule. To see how this works, consider the following 
generalization-example pair (taken from Chamey, 1985): 

Lawsuits are now pending which seek to hold handgun manufacturers and (4) 
distributors liable for the damage caused by their products. 

The family of James Rlordan, a Chicago police officer killed by a handgun, (5) 
is sudig Walther, the We3t German maker of the gun and International 
Armament Corporation, its American distributor. 

Statement 4 is a generalization that asserts the existence of a new type of lawsuit, 
Initiated against manufacturers and distributors of handguns by people who have been hurt 
by the handguns. Statement 5 is an example is of this generalization. It asserts the 
existence of a particular lawsuit, initiated against a specific manufadu^, (Walther), and a 
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specific distributor (the international Armament Corporation), by the Riordan family, who were 
hurt when James Riordan was killed by a handgun. 

The class/member constraint on examples leads to an important difference between 
analogy and exemplification. Tne base and target concepts in an analogy come from 
different domains: a familiar base and an unfamiliar target, in exemplification, on the other 
hand, the oile and the example are both from the same domain, the domain of the skill w 
be learned. Since both constructs are relatively unfamiliar, there is the danger, that the 
learner will not understand the rule well enough to make the appropriate mapping to the 
example. 

Despite this danger, exemplification may aid learning in several ways. First, seeing 
typical objects that the rule might operate on can clarify the general terms in the rule. The 
genora! terms are linked to more concrete and specific concepts. Second, seeing a variety 
of examples and counterexamples can help the learner define the scope of the rule's 
application (Nltsch, 1977; Tennyson, 1973; Tennyson, Wooiley & Merrill, 1972). Third, 
examples may have an important role for establishing the validity or the utility of a rule 
(Perelman & Olbrechts-Tyteca, 1969; Schoenfeid, 1979, Mandi, Schnotz & Tergan, 1984; 
Gibon & Abelson, 1968). Finally, learners can use examples of correctly solved problems as 
models for solving new problems (e.g., Anderson, Sauers & Farreli, 1984). 

With this last use of examples (serving e* models for solutions to new problems), the 
boundary between analogy and exemplification begins to blur, On the one hand, using 
examples as models is analogic in that there is a specific-to-speclfic mapping between the 
constructs (the example and the new problem). Furthermore! as we would expect in an 
analogy* the "base* example is more familiar than the target problem by virtue of having 
been seen or worked on before. On the other hand, unliko analogy, the examples that are 
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used as models are often introduced to the learner in the context of a general principle or 
rule. Further, the model problems come from the same unfamiliar domain as the novel 
problems they are mapped to. Consider, for example, the problems that are laid out in the 
course of a mathematics chapter. A general formula or algorithm is exemplified with specific 
problems that can then be used as models for the chapter-end exercizes. Anderson, Farreii 
and Sauers (1983) explicitly combine generai-to-speclfic and specific-to-specific mappings in 
their analysis of subjects learning to write LISP functions. The subjects were presented with 
an abstract template for defining a function in LISP along with an example of a correct 
function definition. On the basis of protocol analysis, Anderson et a!, conclude that subjects 
first make the exemplification mapping between the template and the example, then 
analogize between the example and the new problem. In spite of the dual nature of this 
type of learning, we will use the term exemplification whenever a general principle or ru e or 
procedure is instantiated with a specific example within a prescribed domain, even when we 
assume that the example is later used as a model. 

3.3. Situational Examples 

We will single out situational examples as an especially rich type of example. Situational 
examples differ from other kinds of instantiations in that they illustrate the contexts in which 
a procedure applies rather than simply illustrating the details of how to execute an abstract 
procedure. The distinction we are drawing between simple instantiations and situational 
examples is similar to that drawn by Mandi, Schnotz and Tergan (1984) between "illustrative 
examples" and "application examples." Both types of examples provide specific instances 
of the general terms of a rule, but the types differ in what other kinds of information they 
provide. 

To illustrate the two kinds of examples, consider the following three sentences. The first 
is a 'uie from a text for teaching students to improve their writing ntyle (Williams, 1981). 
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The second simply instantiates the concepts in the rule, and the third is a situational 
example: 

When a nominaiization follows an empty verb, change the normalization to a (6) 
✓erb that replaces the empty verb. 

For example, normalizations such as investigation, inquiry or response often (7) 
follow empty verbs such as make or conduct Use the verbs investigate, 
inquire or respond instead. 

For example, change the sentence "The police conducted an extremely (8) 
thorough investigation into the incident," to "The police investigated the 
incident extremely thoroughly/ 

The example in Statement 7 instantiates the general terms "empty verb" and 
"nominaiization," but doesn't provide a context in which they might occur. The situational 
example (Statement 8) instantiates the general terms within a specific context. The context 
illustrates something about the situations in which the rule should apply: the nominaiization 
need not follow the empty verb directly, it also illustrates something about hov to carry 
through the solution: changing a noun to a verb can necessitate changes to other parts of 
the sentence. 

if instantiation is the major contribution of an example, then both types of examples 
should aid performance to the same degree. But if it is important to use the example as a 
model or to motivate the use of a procedure, then seeing a situational example should 
improve performance more than seeing a conceptual example. Situational examples may 
also help people remember a rule when they are working on a task, because seeing the 
task may remind them of the example (Rosa, 1984). Finally, situational examples may be 
better for demonstrating the utility of the rule, by showing rather than just asserting that 
following the rule leads to a desirable outcome. 



22 



18 

4. The interaction of Elaboration Types and the Components of Skill Learning 

in this section, we recapitulate the three components of skill learning and analyze the 
potential benefits that specific types of elaborations may have for learning a specific 
component, in particular, wo claim that situation examples are the most useful for skill 
learning because each example can contribute to learning in ail throe components. On the 
other hand, while analogies can be constructed to illustrate each component, they are more 
likely to help people learn the functionality of u procedure than how to execute it or when 
to select it. We will begin by briefly discussing the role of analogies in skiif learning, 
describing their benefits and limitations. Subsequent sections will show in more detail how 
examples can contribute to the three components of skill learning. 

4.1. The Role of Analogies in Skill Learning 

Initially, one might expect analogies to be the most helpful form of elaboration for 
learners since, unlike examples, they fcwofve constructs in a base domain that are highly 
familla; to the learner. As such, analogies may be very useful for clarifying unfamiliar 
concepts. Suppose a novice computer user Is learning to use a personal computer with 
floppy disk drives. The following analogy can help the user anticipate some features of 
diskettes,: 

A diskette is similar to a small, flexible phonograph record, except that (9) 
instead of storing sounds, it contains information that the computer can 
read, add to, or delete. 

By mapping information from his previous knowledge of phonograph records, the user 
may anticipate that diskettes are used in a horizontal orientation and that it Is unwise to let 
the surface of the diskette become dirty or scratched. The usefulness of the analogy is 
somewhat limited, however. Learners may draw spurious assumptions from the analogy, 
e.g., that information is stored on a diskette linearly, as it is on a phonograph record. Or 
they may assume that, like phonograph records, diskettes must be removed from their 
protective covering when they are used. 
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Analogies may also be constructed for motivating the use of some procedures. One 
procedure that nany computer users must learn Is how to specify the location of the file or 
directory they want to work on. The following analogy attempts to motivate the choice 
between two options for specifying the ''path'' through a directory structure. The choice 
arises In the DOS operating system because paths optionally begin with a backslash symbol 
(\). the backslash signals that the path is to start at the top-level (or "root") directory. !f 
the backslash is omitted, the path is assumed to start at the current directory (which may 
or may not be the top-level directory). This analogy compares the specification of a file in a 
directory structure to dialling a local or long distance telephone call. 

When should you specify a path that begins at the root directory? It may be (10) 
useful to draw an analogy to using the telephone to make long-distance 
calls* When you are calling a number within the current area code, you 
don't have to dial or specify your own area code. You Just dial the 
number you want. This Is like leaving off the first backslash in a path; the 
computer assumes you want to stay within the current directory. However, 
if you want to call someone outside the current area code, you dial *V 
and then the new area code- and then the number* The "1" that you dial 
first is analogous to the backslash for the root directory, and the new area 
code Is analogous to the name of another subdirectory where the flies (or 
phone numbers) are stored. 

This analogy clarifies the concept of a path and the appropriate circumstances for 
starting the path at the root directory. Again, however, the analogy is fairly fragile. For 
instance, the computer allows you to "overspecify" the location of a file, but the phone 
company does not. That is, you can specify a path to any file starting at the root 
directory, even a file in the current directory. This would be analogous to dialling "V and 
your own area code. The analogy also breaks down in a very common circumstance: when 
the current directory is the root directory and you wish to specify a path to a subdirectory 
within it, no backslash Is needed. If ail exceptions have to be explained to the user, the 
analogy may be more trouble than it is worth. 

A more important drawback of the analogy Is that It does not help the learner acquire 
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the particular procedures needed for using the operating system. That is, knowing that an 
area code is analogous to a directory name does \*t help the learner master the system- 
specific conventions for specifying a path through a directory structure. So even if the 
analogy were mo.e robust, learners would still have to rely on other means to learn how to 
execute the procedures. 

A$ this dL~us?'~n illustrates, It is possible to construct analogies for various components 
of skill learning, but. the benefit of analogies to limited. Analogies can clarify unfamiliar 
concepts and procedures, y M often cannot hold up at the level of detail to which learners 
must understand and apply the concepts. Analogies are probably least appropriate for 
elaborating on the the execution component of a skill. We believe that examples drawn 
from the domain under study, though less familiar than the base domain of an analogy, are 
more useful to the learner In the long run. if examples are carefully constructed, they may 
simultaneously clarify the function of a procedure, how to execute it and when to select it. 

4.2. The Role of Examples for Conveying Functionality and Motivating Procedures 

Below we introduce two new concepts from computing to illustrate how situational 
examples can motivate as veil as explain a concept or procedure. To give more force to 
our claim that rich situational examples are best for Introducing or teaching these concepts, 
we will present the concepts first with the impoverished examples and then with richer ones. 

4.2.1. Command Editing 

At the time of this writing, using a command editor within an operating system Is a 
relatively novel concept, even for people familiar with computers, since this feature is not 
available on many operating systems. Command editing refers to the ability to retrieve 
commands that were a!;eady Issued to the r/stem and then use them again, either re- 
Issuing them . verbatim or Issuing a modified (edited) version of the command. The 
'nctlonality of command editing can be conveyed with rather straightforward examples; 
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however, If the examples do not illustrate the motivation for Its use, learners won't 
appreciate the feature and when it is most useful. Consequently, they won't use the 
procedures regularly and will probably forget all about them fairly rapidly. 



Consider the following example that explains wha* command editing means, but falls to 
motivate its use (the example pertains to a modified VMS operating system): 

Suppose you have typed the following sequence of commands into your (11) 
comprter- 

$dlr 
Stinger 
$go .chap 

The first command in this sequence produces a listing of the contents of 
the current directory; the second, a listing of the people currently using the 
machine, and the last, requests that the current directory be changed to a 
subdirectory called "chap".) Njw suppose you want to list the contents of 
the "chap" subdirectory. Using command editing, you press the up-arrow 
a few times so that $go .chap, then tfinqer % then Sdir appear on the 
command line.. Now you need only press the return key to re-issue ihe tdlr 
command for. the .chap subdirectory. 



The above example is sufficient for explaining the functionality of the command editing 
procedure, but Is poor for motivating its use In that it provides little or no savings In 
keystrokes over typing a new cf/r command, in such an example, the usefulness of the 
procedure is obscured and no novice would see the need to spend time learning It. The 
following example, in contrast, should make much clearer the usefulness of the command 
editor. 

Suppose, for example, you want to copy a number of files from someone (12) 
else's account on another system. 4 To copy the first file (called 
"draftl.mss"), you must specify a long path to the relevant directory in 
your friend's account on the other machine: 

$copy cmpsyb::(well8.papere.curchap]draft1 .mss * . * 

Suppose you want to copy another file called "flnal.mss" from that same 
location. One way to do so would be to type a new copy command that 
would look exactly the same as the command above, »..cept that 
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"finai.mss" wcMd appear in place of "draftl.mss." However, re-typing the 
command will require 58 keystrokes for each file you want to copy. And If 
you enter the command with unnoticed typing mistakes in the path or the 
filename, you will have to type the entire command again. Command 
editing saves you ail of this re-typing, instead of re-typing, you simply 
'recall 9 the last copy command and edit it to change the name of the file. 
Typing the up-arrow key brings back the last command. Then, by striking 
the jft-arrow key, you can move the cursor leftward to the specific 
characters in the filename that must be changed. When you are finished 
changing the name of the file, press RETURN to issue the modified 
command. By editing ana re-using your first copy command, you save 
nearly 40 keystrokes for each file you have to copy and you reduce the 
chances of error In retyping the whole command. 



Both examples clarify tha concept of re-issuing a command. By specifying the sequence 
of keys ahat must .be typed, both examples also instantiate the rules for executing the 
command editing procedures. Only the situation example, however, illustrates the conditions 
under which the command editing f.^c^dure Is more desirable than the procedure for 
issuing a now command, in particular, command editing is worthwhile when you must type 
a number of long, similar commands. We will return to the issue of learning when to use 
a procedure in section 4A below. 

4.2.2. Subdirectories 

Consider another example from the same general' domain. We have mentioned 
subdirectories in the course of the preceding example. This construct may also be 
unfamiliar to many readers or 'Ms chapter. Simply stating that a directory can be divided 
into subdirectories is sufficient for "explaining" the concept, but It is unlikely that the user 
will be sufficiently motivated to acquire the cluster of skills needed to make use of such a 
facility. 



The following example, taken from the IBM DOS Manual (Anonymous, 1983), illustrates 
the concept more fully along with some rationale for the usefulness of subdirectories, but 
adds little to the reader's sense of how subdirectories might facilitate day-to-day activities on 
the computer. 



27 



DOS Version 2.00 gives you the ability to better organize your disk by (13) 
placing groups of related files in their own directories - ail cn the same 
disk. For example, let's assume that the XYZ company has two 
departments (sales and accounting) that share an IBM Personal Computer. 
All of the company's flies are kept on the computer's fixed disk. The 
logical organization of the file categories could be viewed like this: 

Disk 
• « 

Sales Accounting 

• • • • 

• • • • 

David Joanne Don Karol 

• • • • • • 

• • • • • • 

Reports . Reports Reports . Reports 

Customer . 1st Accts. rec 

With DOS Version 2.00, it is possible to create a directory structure that 
matches the file organization. With this ability, all of DAVID'S report files 
can be grouped together in a single directory (called REPORTS), separated 
from all the other files on the disk. Likewise, all of the accounts 
receivable files can be in a unique directory, and so on. 

The example above implies that subdirectories are only useful when different people are 
using the same disk. Even then, it doesn't illustrate the advantage subdirectories have over 
a single directory for any given user, in order to convey the usefulness of subdirectories, 
the learner might be shown a "one-level* directory filled with many unrelated files and told 
to Imagine trying to find a file for which the name can be recognized but not easily 
recalled. The figure below is an example of a listing of files in a flat or one-level directory. 
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Directory CMPSYB: : PSY$USER: [ANON] 



2APA.REF;6 


2SCS.DAT; 1 


A5HRTR3.MSS;7 


APAREF.LIBjl 


CAU.MSS;15 


CHP2BIB.AUX;1 


CHP2BIB.MAK;3 


CHP2BIB.MSS;10 


CHP6BIB.MAK;3 


CHP6BIB.MSS;12 


CHP7BIB.MAK;1 


CHP7BIB.MSS;14 


CIANCI.MSS;3 


COLDSA.DAT; 1 


C0PING1.DAT? 1 


DEBBIB.AUX;1 


DEBBIB.MSS;3 


BRBBIB.0TL;1 


D0CU.M0R;1 


D0CU.MSS;1 


EMACSINIT. ; 1 


FILE2.0UT;3 


FMC.DAT;1 


FORM. ERR; 2 


FORM. LET; 1 


FPR0.DAT;2 


FRDPRO.LN0;l 


FRDPR0.MSS;1 


FREUD.LN0;2 


FREUD.MSS;13 


FRBUD2.LN0;1 


FREUD2.MSS;1 


GPSCIBIB.AUX;3 


GPSCIBIB.MSS;4 


GRADE. BAS;1 


HEARTBIB. AUX; 1 


HEARTBIB . MAK; 10 


HEARTBIB. MSS; 19 


HEARTBIB1 . MSS ; 3 


HRTBIBADD . MAK; 3 


HRT3IBADD.MSS;2 


IM?.FRM;2 


IM?FRM.MSS;8 


INST. MSS ;1 


INTERR.SPS;1 


J?AREV.MSS;1 


JUNR.DT;1 


JUNK2.DT;1 


LMFF.MSS;1 


L0GIN.COM; 6 


LOT.OTLjl 


LOT.OUlfl 


LOT2.0TL;10 


L0T2R.0TL;S 


LOTA. MSS; 8 


L0TREF.AUX;19 


L0TRBP.MSS;18 


L0TREF.0TL;14 


L0TTAB4.MSS;13 


MAIL.MAI;1 


MALIAS.;4 


KB0X.;2 


METHOD. MSS;4 


MFSBI0.MSS;9 


MIKE.MSS;2 


HIKE.0U1;1 


MYAPA.LIB;2 


M YAP A. REP; 2 


MYREG.C0N;1 


MYREG2.C0N;1 


NBTL0GIN.COM; 2 


NETSERVER.LOG; 15 


NBVSCS.DAT; 2 


NOTES. MSS; 2 


NYEAR. ;1 


PI. MSS; 30 


P2.MSS;51 


P3.MSS;11 


PC0RR.SPS;1 


PFU.MSS;20 


PILL. CON; 1 


PILL.DTjl 


PILL2.DT;1 


PLAN.; 2 


POSURG.DAT; 1 


PRB2.MSS;4 


PREFACE. MSS; 3 


PRETEST. MSS; 9 


PROO.DATjl 


PR0T.DAT;1 


QUES.;1 


QUEST. ;1 


QUEST. MSS $6 


RA.MSS;1 


RAL0T.SPS;1 


REG.MSS;1 


REV1.;1 


SA3.DAT;1 


SA3.SRT;3 


' SAMPLE. MSS; 1 


SAREP.MSS;3 


SAREF.0TL;3 


SCHBIB.MSS;28 


SCORES. DT;1 


SCRIBE. LOG; 1 


SCRIPT. MSS; 1 • 


SCS.MSS;4 


SECOND. QUE; 6 


SBVEN.Q'JE;4 


SF2F.SPS;3 


SHVITA.MSS;31 


SHVITA1.MSS;1 


SIG.LBT;1 


SIGMA1.MSS;1 


SIGNUP. ;1 


SIX. LPT; 1 


SIX. QUE; 1 


SOCANX.DAT; 1 


S0CSU?.MSS;3 


SPSS.T2T;1 


SPSS1.TXT; 1 


SPSS2.TXT; 1 


STATE. ;2 


SUM. MSS; 1 


SUM1.MSS;4 


SUP.;1 


SUPPORT. MSS; 9 


TA.;3 


TAB7.MSS;3 


TABLE1.MSS;1 


TABLE2.MSS;! 


TABLE4.ERR;! 


TABLE4.MSS;! 


VCR.;1 







Total of 134 files. 



Often people forget the exact name they gave to a file. They correctly believe that they 
can often recognize the name from a complete listing of file names; however, in a directory 
such as the one above, as many as 134 filenames might have to be inspected. Contrast 
the directory listing above with the one below: 





Directory CMPSYB: : PSY$USER: [NEAT-NIK] 



COURSES . DIR ; 1 • EMACSINIT . ; 1 

LOGIN. COM; 57 MALI AS. ;6 

MSS.DIR;! PLAN.jl 



EXPER.DIR;1 
MAIL.; 17 



INFO. DIR ;1 
MISC. DIR; 1 



Total of 10 files. 

Each of the subdirectories (i.e., the entries with .dir suffixes) may contain files and still 
deeper subdirectories (e.g., under 'courses* are subdirectories for specific courses, and 
under *exper* are subdirectories with the data and materials for specific experiments.) 
Searching for a particular Ale may still take some looking around; however, assuming the 
user knows the category of the file, the number of individual filenames that must be 
inspected is much smaller. 

By contrasting the situations for finding a file with and without subdirectories, the pair of 
example directories above clarifies what subdirectories are, as well as motivating the* 
circumstances for their creation (e.g., whenever a user has a large number of flies that can 
be categorized fairly easily). Carefully constructed situational examples can thus illustrate 
both why the feature is useful and when it Is most appropifate or efficient to use. 

4.3. The Role of Examples for Learning How to Execute Procedures 

We believe that examples can give the learner the most concrete, most specific picture 
of exactly what to do while executing a procedure and making the necessary adjustments to 
specific task situations. The procedures that benefit most from exemplification are these 
that involve the interpretation of a general rule. An uneiaborated <uie, with its special 
nidation, variables, symbols, general terms, etc., is usually too abstract for learners to 
comprehend, in this section, we will describe various ways in which examples can facilitate 
exocutlon, including clarifying the spirit of a rule and providing a model for future solutions. 




30 



26 



4.3.1. Learning to integrate a Collection of Operations: Command Editing 

Command editing, a procedure introduced in the last section, is not a difficult concept to 

grasp; however, whether or not it is easy to execute depends on the nature of thr# system 

implementation. Both the OOS and VMS operating systems have command editing features, 

but the Implementations differ in several important respects, such as providing external cues 

to relevant operations. For example, on the IBM PC, the key that recalls the previously 

issued DOS command is the F3 button. Of the 10 function keys on tte keyboard, there is 

no obvious reason why the desired key should be F3. Once the previous command is 

recalled, the user may edit it using a key labelled "Ins" that toggles the system between 

Insert and overwrite modes, and a key labelled "Del" that puts the machine Into delete 

mode. In contrast, it may be easier to remember how to initiate command editing In VMS 

because there are up-arrow and down-arrow keys that are uniquely associated with going 

back over a buffer of previously Issued commands. Once a command is recalled, however, it 

i 

may be harder to remember how to toggle from Insert mode to overwrite mode because 
there are no overt function keys; the relevant sequence of keystrokes Is the non-mnemonic 
control-a. 

Command editing thus consists of a collection of operations for viewing and retrieving 
items in a buffer and changing the mode or state of the computer. The operations 
themselves are fairly simple: usually consisting of a single keystroke. As a result, the 
execution component of command editing is not easily described with a general rule; rather, 
learners must remember all the component operations and determine how to sequence them, 
situational examples that show learners a complete interaction should be very valuable. 4 



'The situational example about command editing presented earlier (Example 12) provides much of the 
necessary description. To have fullest effect, the editing operations should probably be described more fully 
and should be set off from the body of the ta/t. 
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The most difficult aspect of learning to execute this type of procedure may be 
remembering the arbitrary association of a key and a function. An additional benefit of 
examples may be to strengthen memory traces for such associations through repetition in a 
concrete context. 

4.3.2. Learning to Generate Instances of a Rule: Renaming Files 

Among the types of procedures that are hardest to learn to execute are those that 
require the learner to generate a particular instance of an abstract rule. Examples of these 
procedures were provided earlier: learning to perform a Mest, learning to issue computer 
commands, or defining a function In a programming language. As discussed above, 
executing this type of procedure requires that the learner remember the name(s) of the 
procedure, the details of the rule or sequence of operations and how to assign values to 
any variables that appear in the rule. 

Examples can help people learn this type of procedure in several ways. Consider the 
following typical example that was intended to help learners parse a rule, in this case, a 
rule for renaming flies on the IBM-PC. In the manual, the example in 15 follows the 
general rule in 14. 

REN (AM E] [d][path)fflename[.ex{\ filename{.exf\ (14) 

For example, the command: 

REN B: ABODE HOME (15) 
renames the file ABODE on drive B to HOME. 

The example clarifies some notatlonal aspects of the rule. Elements tl t appear in 
square brackets In the rule are optional; in the example, the last three letters of the name 
of the command and the path are omitted. One problem with the example is that it does 
not clarify under what conditions the optional elements can be omitted. A series of 
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situational examples that contain different combinations of optional elements might be 
necessary to illustrate these points. The example does begin to illustrate the distinction 
between constant terms and variables. Elements in the rule * s at are printed in italics are 
variables, in the example, the Italicized elements have been replaced. The eft is replaced 
by 6: and the first instance of filename is replaced by ABODE. 

One serious problem with this example is that the filenames ABODE and HOME do not 
seem very typical of real filenames and, more importantly, they do not signal which is the 
old name and which is the new name of the file, if learners have trouble figuring out and 
remembering the order of the arguments in the rule, remembering this example is unlikely to 
help them. Some manuals attempt to solve this problem with examples like the following: 

RENAME OLDFiLE NEWFILE (16) 

While the "filenames* in this example do signal the function of the arguments, they are 
far from typical examples of filenames. Since real filenames do not typically refer to 
functions in rules, using this type of example may ultimately confuse the learner. The 
filenames are poor illustrations of what the "fillers" of the argument slots may iook like. 
The following situational example is better: 

Suppose you have a file called BUDGET that contains your budget for 1985. (17) 
Now you want to create a new budget for 1986, but you need a way to 
keep the files for the two years distinct. The command: 

RENAME BUDGET BUDGET.85 

changes the name of the existing file BUDGET to BUDGET.85. Now you 
can create a file for the new budget called BUDGET.86, and it will be 
easy to distinguish the two flies. 

in addition to clarifying aspects of notation, this example also clarifies the functions of 
the two ordered arguments or parameters In the rule: the first is the old name and the 
second Is the new name. The example also helps to motivate the use of the rename 

33 



29 



command, by presenting a situation in which renaming a file makes sense. As mentioned 
above, additional examples of the same sort may be needed to Illustrate other aspects of 

rute. 5 

The results of Reder, Charney and Morgan (in press) suggest that rich examples of 
correct commands help people learn to generate thoir own commands. Indeed, elaborations 
on the execution of procedures proved to be more important to learners than elaborations 
on the function and motivation of the commands. We systematically varied whether or not a 
computer manual contained syntactic elaborations (e.g., examples of syntactically correct 
commands to illustrate more abstract rules for the commands) or conceptual elaborations 
(e.g., analogies illustrating the basic concepts, examples of situations in which a command 
would be useful). Factorially combining the two types of elaborations produced four versions 
of the man jal. Figures 1 and 2 are corresponding excerpts from two of the manuals, 
describing the CHDIR ("Change Directory") command; Figure 1 contains just conceptual 
elaborations and Figure 2 contains just syntactic elaborations. 



Insert Figures 1 & 2 about here 



After they studied a version of the manual, subjects were asked to carry out a set of 
ordinary tasks on the computer, without refering back to the documentation. The subjects 
who had studied manuals containing syntactic elaborations worked significantly more quickly 

^> • 

rule Itself, taken from the DOS manual, Is not very Informative about the function of the arguments (or 
parameters). The following statement of the rule might be better; 

RENAME [location and current name of file] [new name of mi 

Research suggests, however, that even this form of the rule benefits from exemplification (Reder, Chemey & 
Morgan, In press). 

j ERIC 34 



30 



and issued significantly fewer commands. The conceptual elaborations did not significantly 
improve performance, perhaps because the selection of appropriate commands was fairly 
obvious for this particular set of tasks. 

There is other evidence that examples strongly influence subjects 1 interpretation of 
procedural rules. LeFevre and Dixon (1984) and LeFevre (1985) conducted research on 
instructions for solving analogy problems. They found that when verbal instructions for how 
to solve a problem (I.e., rules) were contradicted by a situational example, subjects tended 
to execute a procedure that was consistent with the example rather than one consistent with 
the rule. We suspect that because the examples were concrete and specific, subjects 
mistrusted their interpretation of the more abstract rule and reinterpreted the rule to conform 
to the operations illustrated in the example, in any case, the results underscore the 
importance of choosing examples carefully. 

4.4. The Role of Examples for Learning and Remembering to Select the Best Procedure 

Various factors may cause a learner to select a less than optimal procedure for solving 
some problem. The learner may know that one procedure is more appropriate for a 
problem than another, but if she only remembers how to execute the sub-optimal one, that 
is the one she will end up using. In this sort of situation, the learner has mastered the 
selection problem; she simply needs more help with the execution of the procedures she 
has learned. In contrast, the situations we are mainly interested In concern people who 
don't think of using a procedure that they would acknowledge to be more appropriate and 
people who haven't learned to judge between alternative procedures. 

We believe that situational examples can play a dual role in procedural selection. First, 
they can provide the relevant stimulus cues to help the user "think of the right procedure 
for a specific situation, and second, they can help people learn or induce a generalization 
for when a given procedure is better than some alternative. 

* 

35 



31 

4.4.1. increasing the Salience of Alternative Procedures: Command Editing 

Consider again the Command Editing procedure, it is quite possible for a user who 
knows what command editing is and who remembers how to bring back previous commands, 
to type in a long command instead of modifying and reissuing a similar command that he 
recently issued. The procedure simply may not have been sufficiently salient that it 
occurred to the user at the appropriate time. If a person oniy thinks of one procedure to 
achieve a specific goal then the problem of selection doesn't arise. 

It Is interesting to speculate on what aspects of a hypothetical situation example are 
most likely to increase salience and facilitate retrieval of the procedure in a real problem 
situation. Retrieval Is probably most likely when the example and the problem are identical 
or very similar. Under these circumstances, many elements in the problem situation may 
remind the learner of the example, and hence the procedure used in, the example. 
Unfortunately, since the procedures in a computer operating system can be usod in such a 
wide variety of contexts, it is highly unlikely that the problems users face will be exactly like 
the examples in the manual, even if the examples are carefully chosen, 

What happens, then, when the actual problem situation does not perfectly match the 
example? In part, this will depend on how the example is represented in memory and how 
good the example is at illustrating the relevant dimensions of the situation to encode. We 
believe that the same examples that best motivate why a person should want to use the 
command editing facility will also be best for reminding a person to use it because these 
examples highlight those elements of the problem situation that make the command most 
appropriate. As long as a problem situation matches the example on those dimensions, the 
example may serve as a good retrieval cue, in spite of other differences between the 
situations. On the other hand, it is possible that a learner will oniy store a superficial 
representation of the example; in this case, examples that literally match aspects of the 
current situation will be better memory cues. 
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To illustrate these two possibilities, consider agcin the two examples on command editing 
that were provided earlier (Examples 11 and 12), In the* light of the following Veal world" 
problem. Suppose your friend Smith has a subdirectory called "upkeep" on his computer 
that contains files with helpful information about maintenance and repair people. Smith has 
given you permission to browse through his files from your account on another computer. 
To see what flies are available in the subdirectory, you type a relatively long command, 
such as the following: 

$dlr onion::[Smlth.home.upkeep] 

To read the contents of any file in the "upkeep" directory, you will have to issue 
commands of the form: 

$type onion: :(Smith.home.upkeep]plumbefs.mss. 

The question is, will you be more likely to remember to use command editing in this 
situation (i.e., changing the dir command into the needed type command and reissuing it), if 
you had previously seen example 11 or example 12 In the manual? Example 11 
superficially resembles the problem situation, in that both involve typing and later reissuing a 
dir command. Example 12 showed how to avoid retyping a different command, the copy 
commend. However, the point of this example was to motivate why one would want to 
bother with command editing: to save keystrokes by avoiding retyping a very long file 
specification or "path" to a file. So despite the greater superficial similarity of Example 11 
to the problem situation, Example 12 should be a better cue to a user's memory. This 
assumes that users represent tasks and goals at a deeper level, e.g., "My goal is to save 
keystrokes and re-use the expression that I already typed." It is obviously an empirical 
question how users tend to encode the examples they read in a manual. 
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4.4.2. Learning to Judge When One Procedure Is Better Than Another: Command Editing 

Skill learners should be familiar with a repertoire of procedures and should be able to 
select the most appropriate procedure for any given situation. An obvious question is what 
makes a procedure most appropriate? At various points in this chapter, we have described 
situations in which one procedure is 'better* than another. In most cases, we have 
justified this valuation in terms of efficiency: one procedure saves the user keystrokes (e.g., 
command editing) or reduces the size of the search space (e.g., creating subdirectories). 
Often, of course, the choice between procedures is not so clear-cut. Consider the choice 
between procedures for writing a computer program: e.g., should the programmer write a 
recursive program or an iterative one? It may be easier to write a computer program 
way, but the program may be more computationally efficient another way. To the extent 
that the considerations for choosing between procedures can be specified, we are interested 
In how instructional texts can help learners acquire such selection strategies. 

As we argued in the preceding section, situational examples highlight those 
characteristics of a situation that make a particular procedure highly appropriate. Consider 
again the two examples used to illustrate the command editing procedure. Example 11 
illustrated a situation in which command editing was no more efficient than typing a new dlr 
command. In Example 12, however, command editing was by far the more efficient 
procedure, because the user could avoid typing a number of copy commands that all 
contained the same long path specification. We can use this characteristic of the task 
situation to formulate a generalization about when to choose command editing: 

If you must issue a number of very long, similar commands, it is more 
efficient to edit the commands than to type new ones. 

One way to convey a selection principle such as this would be to state it explicitly in a 
computer manual or Instructional text. As with any generalization, a selection r Inclple can 
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be Illustrated with examples, In this case, situation examples. Since, as we have seen, 
situation examples can also be used to exemplify syntactic rules for issuing computer 
commands, situation examples have the potential of simultaneously Illustrating two sorts of 
rules: rules for executing procedures and generalizations for when to select the procedures. 
Of course, it may not always be necessary to state the selection principle explicitly. We 
speculate that (earners who see a number of situation examples can often induce the 
generalization independently. 

The extent to which learners need help choosing between alternative procedures Is a 
question which requires further research. We have found that learners can often choose the 
most efficient computer command without the benefit of explicit advice, whether exemoilfied 
or not (rider, Chamey & Morgan, in proas; Chamey, 1985). !• may be that instruction is 
needed more in more complex skill domains, such as programming. 

4.5. Some Potential Drawbacks to Situational Examples 

Our analysis suggests that situational examples must be chosen carefully to illustrate the 
conditions under which a procedure should be applied. The example must make salient the 
underlying goal of the procedure as well as illustrating a situation where it is used, if the 
examples are poorly constructed, they can actually Interfere with cviod performance. Wher 
subjects only see impoverished examples, that fail to emphasize the conditions that make 
one procedure more appropriate than another, the subjects may draw spurious conclusions 
about when to use the procedures. 

Consistent with this analysis, Ross (1984) found that superficial similarities between the 
problem that subjects are currently working on and examples they previously saw in the 
instructional materials influenced their choice of procedure. Ross's subjects learned pairs of 
alternate procedures for using a computer text editor, in the instructional materials, each 
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procedure was illustrated with a different superficial situation. For example, one procedure 
for Inserting a word was illustrated in a task involving a shopping list. Th^ example for the 
other word-Insertion procedure involved a course listing. When subjects subsequently worked 
on editing a shopping list, they tended to use die procedure they had seen associated with 
a shopping list, even though either procedure would have worked equally well. As Ross 
points out, this effect of 'reminding* has potentially adverse consequences: in subsequent 
studies, Ross found that subjects tended to use the procedure they were reminded of, even 
if It wts inappropriate for the problem at hand. Further research is needed to determine 
whether rich situational examples that clarify conditions on application can overcome the 
effect of reminding. 

Them Is another problem with examples that we have thus far not addressed: people 
vary In their willingness to read and work through them. Some subjects in our studies on 
computer manuals told us that they don't like to read any more prose than they have to; 
they search for the examples and rely heavily on those. Other people do not want to be 
bothered reading examples, especially <Jrawn* out situational examples that take 3ome effort 
to comprehend. To accommodate both sorts of readers, we intentionally set off the examples 
in this chapter, so that readers could easily identify them as such. We believe that one's 
understanding of the paper will be greater if an attempt is made to 'work through' the 
examples, but we know that not everyone will do so. Indeed, lack of motivation to read 
elaborations may have been part of the reason why n^der and Anderson found that subjects 
learned the main points of a textbook chapter better in summary form, when all elaborations 
were omitted (e.g., Reder & Anderson, 1980, 1982; Reder, 1982; Allwood, Wikstrom & 
Reder, 1982). Examples therefore must satisfy one further constraint: they must seem 
sufficiently interesting to capture the reader's attention or the text must convince the read* 
that he cnnot understand the material without reading the examples. 



36 

5. Conclusion and Further Remarks 

in this chapter, we outlined three basic components of skill learning: learning what kinds 
of procedures are available in the skill domain and What objects they operate on; learning 
how to execute procedures; and learning the conditions under which procedures can and 
should be applied. We discussed various types of elaborations and apacuiated about what 
types of elaborations in an instructional text might facilitate each component most. We 
argued that situational examples are likely to be the most useful sort of elaboration since 
they can perform triple duty, facilitating learning of each of the three components. However, 
since learners tend to rely on examples as models, It is very important to choose examples 
with great care and to provide enough examples to illustrate the range of application of a 
rule. Otherwise, learners may not interpret the rules correctly or they may make spurious 
assumpuw. tbout the conditions under which a rule applies. 

Finally, we think it is interesting to note that our conception of the necessary 
requirements for skill acquisition resembles McGulre's (1961) theory of Stimulus-Response 
Lecrning. McGuire's theory was developed to account for data from a paired-associate 
learning paradigm of almost half a century ago, in which either the stimulus or the response 
term could be a cvc nonsense syllable, and learners needed to know which response cvc 
went with a given stimulus cvc. McGuire's theory posits three components to learning a 
particular association: the learner must learn to discriminate the stimulus from competing 
stimuli, learn the response and then learn to link the two together. Despite the difference 
in domains, one can draw the parallels to our view of skill acquisition. The ■earner must 
understand the functionality or nature of the procedure (learning or discriminating the 
stimulus), ieam the exact sequence of actons for executing a procedure (learning the 
response), and execute the correct procedun for a specific situation (learn to link the 
stimulus and response terms). Linking the stimulus and response terms is like learning the 
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best procedure for a given situation because understanding the functionality 01 a procedure 
entails the recognition that it Is appropriate In certain contexts. 



ERIC 42 



38 

References 

Anderson, J.R., Farre:i, R., & Sauers, R. (1984). Learning to program in LISP. Cognitive 
Science ,8, 87-129. 

Anderson, J. R. (1982). Acquisition of cognitive skill. Psychological Review ,89, 369-406. 
Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA Harvard University 
Press. 

Anderson, J. R., & Reder, L. M. (1979). An eiaborative processing explanation of depth of 

processing, in L S. Cermak & F. I. M. Craik (Eds.), Levels of processing in human 

memory. Hillsdale, NJ: Eribaum. 
Bransford, J. D. (1979). Human cognition: Learning, understanding and remembering. 

Belmont, CA Wadsworth. 
Card, S., Moran, T., & Newell, A. (1983). The psychology of human computer interaction. 

Hillsdale, NJ: Eribaum. 

Charney, D. (1985). The Role of elaborations in instructional texts: Learning to use the 

appropriate procedure at the appropriate time. Unpublished doctoral dissertation, 

Carnegie-Mellon University. 
Chiesi, H. L, Spiiich, G. J., & Voss, J. F. (1979). Acquisition of domain-related information 

in relation to high and low domain knowledge. Journal of Verbal Learning and Verbal 

Behavior , 18, 257-273. 

Craik, F. I. M., ft TuMng, E. (1975). Depth of processing and the retention of words in 

epIsocVc memory. Journal of Experimental Psychology: General , 104, 268-294. 
Fitts, P. M. (1964). Perceptual-motor skill learning, in A W. Melton (Ed.), Categories of 

human learning. New York: Academic Press. 
Gentner, D. (1980). The structure of analogical models in science (Technical Report 4451). 

Bolt Beranek and Newman. 
Gentner, D. (1983). Structure-mapping: A t' joretical framework for analogy. Cognitive 

Science ,7, 155-170. 

43 



39 

Giison, C, and Abeison, R. (1968). The subjective use of inductive evidence. in 

P. C. Wason & P. N. Johnson Laird (Eds.), Thinking and reasoning. Harmondsworth, 

Middlesex, England: Penguin Books. 
Hayes, J. R., & Simon, H. A. (1974). Understanding written problem instructions, in 

L. W. Gregg (Ed.), Knowledge and cognition. Potomac, MD: Eribaum. 
Hobbs, J. (November 1978). Why is discourse coherent? (Technical Note 176). SRI 

International. 

Microsoft, Inc. (1983). IBM Personal Computer Language Series, Disk Operating System, 

Version 2.00. Boca Raton, FL: IBM. 
Weras, D. & Bovair, S. (January 1985). The acquisition of procedures from text: A 

production-system analysis of transfer of training (Technical Report 16). University of 

Michigan. 

Weras, D. (February I985). The role of priot knowledge In operating equipment from written 

instructions (Technical Report 19). University of Michigan. 
LeFevre, J. (Spring 1985). A model of the use of instruction and example information on a 

simple Inductive-reasoning task. Master's thesis, Department of Psychology, University 

of Alberta. 

LeFevre, J. & Dixon, P. (1984). Do written instructions need examples. Unpublished 

manuscript, University of Alberta. 
Mandl, H„ & Ballstaedt, S. (September 1981). Effects of elaboration on recall of texts. 

Paper presented at the international Symposium on Text Processing, Frlbourg. 
Mandl, H., Schnotz, W., & Tergan, S. (April 1984). On the function of examples in 

instructional texts. Paper presented at the AERA meeting, New Orleans. 
McGuire, W. J. (1961). A multi-process model for paired-associate learning. Journal of 

Verbal Learning and Verbal Behavior ,62, 335-347. 
Newell, A., & Simon, H. A. (1972). .Human problem solving. Engiewood Cliffs, NJ: 

Prentice-Hall. 

44 



40 

Newell, A., & Rosenbloom, P. S. (1981). Mechanisms of skill acquisition and the law of 
practice. In J. R. Anderson (Ed.), Cognitive skills and their acquisition.. Hillsdale, NJ: 
Erlbaum. 

Nltsch, tC E. (1977). Structuring decontextuallzed forms of knowledge. Unpublished doctoral 

dissertation, Vanderbllt University. 
Perelman, C, & Olbrechts-Tyteca, L. (1969). The new rhetoric: A treatise on argumentation. 

Notre Dame, Indiana: University of Notre Dame Press. 
Reder, L. M. (In press). Beyond associations: Strategic components In memory retrieval. 

In D. Gorfeln & R. Hoffman (Eds.), Memory and learning: The Ebbinghaus Centennial 

Conference. Hillsdale, NJ: Lawrence Erlbaum Associates. 
Reder, L. M. (1976). Tne role of elaborations In the processing of prose. Doctoral 

dissertation, University of Michigan. Available through University K 'crofilms, Ann Arbor. 
Reder, L. M. (1979). The role of elaborations In memory for prose. Cognitive Psychology 

,11, 221-234. 

Reder, L. M., & Anderson, J. R. (1980). A comparison of texts and their summaries: 
Memorial consequences. Journal of Verbal Learning and Verbal Behavior ,19, 121-134. 

Reder, L. M., & Anderson, J. R. (1982). Effects of spacing and embellishment on memory 
for the main points of a text. Memory and Cognition ,10, 97-102. 

Reder, L M., Charney, D., & Morgan, K. (in praas). The role of elaborations in leaning a 
skill from an instructional text. Memory and Cognition ,. 

Rosenbloom, P. S., & Newell, A. (in press). Learning by chunking: A production system 
model of practice. In D. Klahr, P. Langley, & R. Neches (Eds.), Selfmodifying 
production systems: Models of learning and development. Cambridge, Mass: Bradford 
Books/MIT Press. 

Ross, B. (1984). Remlndlngs and their effects in learning a cognitive skill. Cognitive 
Psychology ,16, 371-416. 

45 



41 



Schneider, W., & Shiffrin, R. M. (1977). Controiied and automatic human information 

processing. I. Detection, search, and attention. Psychological Review ,84, 1*66. 
Schoenfeld, A. (1979). Can heuristics be taught? in J. Lockhead & J. Clements (Eds.), 

Cognitive process instruction. Philadelphia: The Franklin institute Press. 
Shiffrin, R. M., & Schneider, W. (1977). Controiied and automatic human information 

processing: I. Detection, search, and attention. Psychological Review ,84, 1-66. 
Chriffrin, R. M., & Dumais, S. T. (1981). The development of automatism. In 

J. R. Anderson (Ed.), Cognitive skills and their acquisition. Hillsdale, N.J.: Erlbaum 

Associates. 

Tennyson, R., Wooliey, F., & Merrill, M. (1972). Exemplar and nonexemplar variable** which 

produce correct concept classification behavior and specified classification errors. 

Journal of Experimental Psychology , r >3, 144-152. 
Tennyson, R. (1973). Effect of negai instances in concept acquisition using a verbal 

learning task. Journal of Experimental Psychology ,64, P47-260. 
Weinstein, C. E. (1978). Elaboration skills as a learning strate<~v. m H. F. O'Neil, Jr. (Ed.), 

Learning strategies. New York: Academic Press. 
Williams, J. (1981). Style: Ten lessons in clarity and grace. Gienvi9w, IL: Scott, Foresman 

and Company. 



46 



Distribution List [CMU/Reder & Charney] NR 667*529 



1986/02/14 



Dr. Robert Ahlers 
Code N711 

Human Factors Laboratory 
NAVTRABQUIPCFN 
Orlando, PL 32813 

Dr. Ed Aiken 

Navy Personnel R&D Center 
San Diego, CA 92152 

Dr. Earl A. Alluisi 
HQ, AFBRL (AFSC) 
Brooks AFB, TX 78235 

Technical Director, ARI 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Meryl S. Baker 

Navy Personnel R&D Center 

San Diego, CA 9.2152 

Dr. Thomas 6. Bever 
Dept. of Psychology 
Columbia University 
Nev York, NT 10027 

Dr. Henucha Birenbaum 
School of Education 
Tel Aviv University 
Tel Aviv, Ramat Aviv 69978 
ISRAEL 

Dr. Gautam Biswas 
Department of Computer Science 
University of South Carolina 
Columbia, SC 29208 

Dr. John Black 
Tale University 
Box 11A, Tale Station 
Nev Haven, CT 06520 

Dr. Arthur S. Blaives 
Code N711 

Naval Training Equipment Center 
Orlando, FL 32813 

Dr. Robert Blanchard 
Navy Personnel R&D Center 
San Diego, CA 92152 



Dr. Richard Braby 
NTEC Code 10 
Orlando, PL 32751 

Dr. Robert Breaux 
Code N-095R 
NAVTRAEQUI PCEN 
Orlando, FL 32813 

Dr. Ann Brown 

Center for the Study of Reading 
University of Illinois 
51 Gerty Drive 
Champaign, IL 61280 

Dr. Patricia A. Butler 
NIB Mail Stop 1806 
1200 19 th St., NW 
Washington, DC 20208 

Dr. Robert Calfee 
School of Education 
Stanford University 
Stanford, CA 94305 

Dr. Pat Carpenter 
Carnegie-Melldn University 
Department of Psychology 
Pittsburgh, PA 15213 

Dr. Robert Carroll 
NAVOP 01B7 

Washington, DC 20370 

Dr. Fred Chang 

Navy Personnel R&D Center 

Code 51 

San Diego, CA 92152 

Dr. Davida Charney 
Department of Psychology 
Carnegie-Mellon University 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Eugene Charniak 
Brown University 
Computer Science Department 
Providence, RI 02912 

Mr. Raymond E. Chris tal 
AFHRL/MOE 

Brooks AFB, TX 78235 



Distribution List [CMU/Reder & Chamey] NR 667*529 



1386/02/14 



Director, 

Manpower Support and 

Readiness Program 
Center for Naval Analysis 
2000 North Beauregard Street 
Alexandria, VA 22311 

Chief of Naval Bducation 

and Training 
Liaison Office 

Air Force Human Resource Laboratory 
Operations Training Division 
Williams AFB, AZ 85224 

Assistant Chief of Staff 
for Research, Development, 
Test, and Evaluation 

Naval Education ind 

Training Command (N-5) 

NAS Pensacola, FL 32508 

Dr. John J. Collins 
Director, Field Research 

Office, Orlando 
NPRDC Liaison Officer 
NTSC Orlando, FL 32813 

Dr. Stanley Collyer 
Office of Naval Technology 
Code 222 

800 N. Quincy Street 
Arlington, VA 22217-5000 

LT Judy Crookshanks 
Chief of Naval Operations 
0P-112G5 

Washington, DC 20370-2000 

Dr. Mary Cross 
Department of Education 
Adult Literacy Initiative 
Room 4145 

400 Maryland Avenue, SV 
Washington, DC 20202 

CTB/McGrav-Hill Library 
2500 Garden Road 
Monterey, CA 93940 



. ERIC 



CAPT P. Michael Cur ran 
Office of Naval Research 
800 N. Quincy St. 
Code 125 

Arlington, VA 22217-5000 

Dr. Cary Czichon 
Mail Station 3407 
Texas Instruments AI Lab 
P.O. Box 405 
Levisville, TX 75067 

Bryan Dallman 
AFHRL/LRT 

Lovry AFB, CO 80230 

Dr. Natalie Dehn 
Department of Computer and 

Information Science 
University, of Oregon 
Eugene, OR 97403 

Goery Delacote 
Directeur de L'informatique 
Scientifique et Technique 
CNRS 

15, Qua! Anatole France 
75700 Paris FRANCE 

Dr. Sharon Derry 
Florida State University 
Department of Psychology 
Tallahassee, FL 32306 

Defense Technical 

Information Center 
Cameron Station, Bldg 5 
Alexandria, VA 22314 
Attn: TC 
(12 Copies) 

Dr. Thomas M. Duffy 
Communications Design Center 
Carnegie-Mellon University 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Richard Duran 
University of California 
Santa Barbara, CA 93106 



48 



Distribution list [CMU/Reder & Charney] NR 667-529 



1986/02/14 



Barbara Eason 
Military Educator's 
Resource Network 
InterAmerica Research Associates 
1555 Wilson Blvd 
Arlington, VA 22209 

Edvard E. Eddoves 
CNATRA N301 
Naval Air Station 
Corpus Christ! 9 TX 78419 

Dr. John Ellis 

Navy Personnel R&D Center 

San Diego, CA 92252 

Dr. Jeffrey Elman 
University of California, 

San Diego 
Department of Linguistics, C-008 
La Jolla, CA 92093 

Dr. Richard Bister 
Deputy Assistant Secretary 

of the Navy (Manpower) 
OASN (M&RA) 

Department of the Navy 
Washington, DC 20350-1000 

♦ 

Dr. Susan Bmbretson 
University of Kansas 
Psychology Department 
Lawrence, KS 66045 

Dr. Randy Engle 
Department of Psychology 
University of South Carolina 
Columbia, SC 29208 

Dr. William Epstein 
University of Wisconsin 
W. J. Brogden Psychology Bldg. 
1202 W. Johnson Street 
Madison, WI 53706 

ERIC Facility-Acquisitions 
4833 Rugby Avenue 
Bethesda, MD 20014 



Dr. Edward Esty 

Department of Education, 0ERI 

Room 717D 

1200 19th St., NW 

Washington, DC 20208 

Dr. Paul Feltovich 

Southern Illinois University 

School of Medicine 

Medical Education Department 

P.O. Box 3926 

Springfield, IL 62708 

Mr. Wallace Feurzeig 
Educational Technology 
Bolt Beranek & Newman 
10 Moulton St. 
Cambridge, MA 02238 

Dr. Gerhard Fischer 
University of Colorado 
Department of Computer Science 
Boulder, CO 80309 

Dr. Linda Flower 
Carnegie-Mellon University 
Department of English 
Pittsburgh, PA 15213 

Dr. Carl H. Frederiksen 
McGill University 
3700 McTavish Street 
Montreal, Quebec H3A 1Y2 
CANADA 

Dr. John R. Frederiksen 
Bolt Beranek & Newman 
50 Moulton Street 
Cambridge, MA 02138 

Dr. R. Edward Geiselman 
Department of Psychology 
University of California 
Los Angeles, CA 90024 

Dr. Arthur M. Glenberg 
University of Wisconsin 
W. J. Brogden Psychology Bldg. 
1202 W. Johnson Street 
Madison, WI 53706 



49 



Distribution List [CtoU/Reder & Charney] 



NR 



667-529 



1986/02/14 



Dr. Sam Glucksberg 
Princeton University 
Department of Psychology 
Green Hall 

Princeton, NJ 08540 

Dr. Joseph Goguen 
Computer Science Laboratory 
SRI International 
333 Ravensvood Avenue 
Nenlo Park, CA 94025 

Dr. Susan Goldman 
University of California 
Santa Barbara, CA 93106 

Dr. Sherrie Gott 
AFHRL/M0DJ 

Brooks AFB, TX 78235 

Dr. Richard H. Granger 
Departsant of Computer Science 
University of California, Irvine 
Irvi s, CA 92717 

Dr. Wayne Gray 
Army Research Institute 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Henry N. Halff 
Halff Resources, Inc. 
4918 33rd Road, North 
Arlington, VA 22207 

Dr. Nancy F. Halff 
Halff Resources, Inc. 
4918 33rd Road, North 
Arlington, VA 22207 

Dr. Ronald X. Hambleton 

Prof, of Education & Psychology 

University of Massachusetts 

at Amherst 
Hills House 
Amherst, HA 01003 

Dr. Cheryl Hamel 
NTEC 

Orlando, PL 32813 



Dr. Ray Hannapel 
Scientific and Engineering 
Personnel and Education 
Nat i oral Science Foundation 
Washington, DC 20550 

Ms. Carol S. Hargan 
. Manager 
Instructional Videodisc Group 
HumRRO 

1100 S. Washington 
Alexandria, VA 22314 

Mr. William Hartung 
PEAM Product Manager 
Army Research Institute 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Wayne Harvey 
SRI International 
333 Ravensvood Ave. 
Room B-S324 
Menlo Park, CA 94025 

Prof. John R. Hayes 
Carnegie-Mellon University 
Department of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Joan I. Heller 
505 Haddon Road 
Oakland, CA 94606 

Dr. Melissa Holland 

Army Research Institute for the 

Behavioral and Social Sciences 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Claude Janvier 

Directeur, CIRADE 

Universite' du Quebec a Montreal 

Montreal, Quebec H3C 3P8 

CANADA 

COL Dennis W. Jr-vi 

Commander 

AFHRL 

Brooks AFB, TX 78235-5601 



50 



Distribution List [CMU/Reder & Cherney] NR 667-529 



1986/02/14 



Margaret Jerome 

c/o Dr. Peter Chandler 

83, The Drive 

Hove 

Sussex 

UNITED KINGDOM 

Dr. Joseph E. Johnson 
Assistant Dean for 
Graduate Studies 
College of Science and Mathematics 
University of South Carolina 
Columbia, SC 29208 

Col. Dominique Jouslin de Noray 
Etat-Major de l'Armee de Terre 
Centre de Relations Humaines 
3 Avenue Octave Grcard 
75007 Paris 
FRANCE 

Dr. Marcel Just 
Carnegie-Mellon University 
Department of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Richard Kern 
Army Research Institute 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. David Kieras 
University of Michigan 
Technical Communication 
College of Engineering 
1223 E. Engineering Building 
Ann Arbor. MI 48109 

Dr. Peter Kincaid 
Training Analysis 

& Evaluation Group 
Department of the Navy 
Orlando, PL 32813 

Dr. Walter Kintsch 
Department of Psychology 
University of Colorado 
Campus Box 345 
Boulder, CO 80302 



Dr. David Klahr 
Carnegie-Mellon University 
Department of Psychology 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Mazie Knerr 

Program Manager 

Training Research Division 

HumRRO 

1100 S. Washington 
Alexandria, VA 22314 

Dr. Janet L. Kolodner 
Georgia Institute of Technology 
School of Information 
& Computer Science 
Atlanta, GA 30332 

M. Diane Langs ton 
Communications Design Center 
Carnegie-Mellon University 
Schenley Park 
Pittsburgh, PA 15213 

Dr. Robert Lavler 
Information Sciences, FRL 
GTE Laboratories, Inc. 
40 Sylvan Road 
Walthaii, MA 02254 

Dr. Alan M. Lesgold 
Learning R&D Center 
University of Pittsburgh 
Pittsburgh, PA 15260 

Dr. Alan Leshner 

Deputy Division Director 

Behavioral and Neural Sciences 

National Science Foundation 

1800 G Street 

Washington, DC 20550 

Dr. Clayton Levis 
University of Colorado 
Department of Computer Science 
Campus Box 430 
Boulder, CO 80309 

Dr. Charlotte Linde 
SRI International 
333 Ravensvood Avenue 
Menlo Park, GA 94025 



51 



Distribution List [CMU/Reder & Charney] NR 667-529 



1986/02/14 



Dr. Narcia C. Linn 
Lawrence Hall of Science 
University of California 
Berkeley, CA 94720 

Dr. William L. Haloy 
Chief of Naval Education 

and Training 
Naval Air Station 
Pensacola, PL 32508 

Dr. Man ton M. Matthews 
Department of Computer Science 
University of South Carolina 
Columbia, SC 29208 

Dr. Richard E. Mayer 
Department of Psychology 
University of California 
Santa Barbara, CA 93106 

Dr. James McBride 
Psychological Corporation 
c/o Harcourt, Brace, 

Javanovich Inc. 
1250 Vest 6th Street 
San Diego, CA 92101 

Dr. Joe McLachlan 

Navy Personnel R&D Center 

San Diego, CA 92152 

Dr. James McMichael 
Assistant for MPT Research, 

Development, and Studies 

NAV0P 01B7 
Washington, DC 20370 

Dr. Barbara Means 
Human Resources 

Research Organization 
HOC South Washington 
Alexandria, VA 22314 

Prof. Jacques Mehler 
Laboratoire de 
Psychologie 
54, bvd. Raspail 
F-75006 Paris 
FRANCE 



Dr. Arthur Melmed 

U. S. Department of Education 

724 Brown 

Washington, DC 20208 

Dr. George A. Miller 
Department of Psychology 
Green Hall 
Princeton University 
Princeton, NJ 08540 

Dr. Lance A. Miller 
IBM Thomas J. Watson 

Research Center 
P.O. Box 218 

lorktown Heights, NT 10598 

Dr. Lynn Misselt 
HQM-222 

Control Data Corporation 
Box 0 

Minneapolis, MN 55440 

Dr. Andrew R. Molnar 
Scientific and Engineering 
Personnel and Education 
National Science Foundation 
Washington, DC 20550 

Dr. William Montague 

NPRDC Code 13 

San Diego, CA 92152 

Dr. Tom Mo ran 
Xerox PARC 

3333 Coyote Hill Road 
Palo Alto, CA 94304 

Dr. John Morton 
MRC Cognitive 

Development Unit 
17 Gordon Street 
London WC1H 0AH 
UNITED KINGDOM 

Dr. Allen Munro 
Behavioral Technology 
Laboratories - USC 
1845 S. Elena Ave*, 4th Floor 
Redondo Beach, CA 90277 



•52 



attribution Ust [CMU/Reder & Charney] NR 667-529 



1986/02/14 



Spec. Asst. for Research, Experi- 
mental { Academic Programs, 
NTTC (Code 016) 

NAS Memphis (?5) 

Millington, TN 38054 

Assistant for MPT Research, 

Development and Studies 

NAVOP 01B7 
Washington, DC 20370 
Assistant for Personnel 

Logistics Planning, 

NAVOP 987H 
5D772, The Penta^n 
Washington, DC 20350 

Dr. Donald A. Norman 
Institute for Cognitive Science 
University of California 
. La Jolla, CA 92093 

Director, Training Laboratory, 

NPRDC (Code 05) 
San Diego, CA 92152 

Director, Manpower and Personnel 

Laboratory, 

NPRDC 'Code 06) 
San Diego, CA 92152 

Director, Human Factors 

& Organizational Systems Lab, 

NPRDC (Code 07) 
San Diego, CA 92152 

Library, NPRDC 

Code P201L 

San Diego, CA 92152 

Commanding Officer, 

Naval Research Laboratory 
Code 2627 

Washington, DC 20390 

Pr. Harry P. O'Neil, Jr. 
University of Southern California 
School of Education — VPH 801 
Dept. of Educational 

Psychology and Technology 
Los Angeles, CA 90089-0031 



Office of Naval Research, 

Code 1142EP 
800 N. Quincy Street 
Arlington, VA 22217-5000 

Office of Naval Research, 

Code 1142PT 
800 N. Quincy Street 
Arlington, VA 22217-500C 
(6 Copies) 
Psychologist 

Office of Naval Research 
Branch Office, London 
Box 39 

PP0 New York, NT 09510 

Special Assistant for Marine 

Corps Matters, 

0NR Cede 00MC 
800 N. Quincy St. 
Arlington, VA 22217-5000 

Psychologist 
' Office of Naval Research 
Liaison Office, Far East 
AP0 Sap Francisco, CA 96503 

Or. Judith Orasanu 
Army Research Institute 
5001 Eisenhower Avenuo 
Alexandria, VA 22333 

Dr. Jesse Orlansky 
Institute for Defense Analyses 
1801 N. Beauregard St. 
Alexandria, VA 22311 

CDR P T. Par^.ette 
Chiei of Na r 1 Operations 
OP-1126 

Washington, DC 20370-2000 

Dr. Douglas Pearse 

DCIEM 

Box 2000 

Dovnsvtev, Ontario 
CANADA 



53 



Distribution List [CMU/Reder & Charney] NR 



667-529 



1986/02/14 



Dr. Nancy Pennington 
University, of Chicago 
Gradrate School of Business 
1101 E. 58th St. 
Chicago, IL 60637 

Military Assistant for Training and 

Personnel Technology, 

OUSD (R & E) 
Room 3D129, The Pentagon 
Washington, DC 20301 

Dr. Ray Perez 

ARI (PBRI-II) 

5001 Eisenhovei Avenue 

Alexandria, VA 2233 

Administrative Sciences Department, 

Naval Postgraduate School 
Monterey, CA 93940 

Dr Steven Pinker 
Department of Psychology 
E10-C18 
M.I.T. 

Cambridge, MA 02139 

Dr. Tjeerd Plomp 

Tvente University of Technology 

Department of Education 

P.O. Box 217 

7500 AE ENSCHEDE 

THE NETHERLANDS 

Dr. Martha Poison 
Department of Psychology 
Campus Box 346 
University of Colorado 
Boulder, CO 80309 

Dr. Peter Poison 
University of Colorado 
Department of Psychology 
Boulder, CO 80309 

Dr. Steven E. Poltrock 
MCC 

9430 Research Blvd. 
Echelon Bldg #1 
Austin, TX 78759-6509 



Dr. Joseph Psotwa 
ATTN: PERI-1C 
Army Research Institute 
5001 Eisenhower Ave. 
Alexandria, VA 22333 

Lt. Jose Puente Ontanilla 
C/Santisima Trinidad, 8, 4 E 
2S010 Madrid 
SPAIN 

Dr. Lynne Reder 
Department of Psychology 
Carnegie-Mellon University 
Schenley Park 
Pittsburgh, PA 15213 

CDR Karen Reider 
Naval School of Health Sciences 
National Naval Medical Center 
Bldg. 141 

Washington, DC 20814 

Dr. Fred Reif 
Physics Department 
University of California 
Berkeley, CA 94720 

Dr. Lauren Resnick 
Learning R&D Center 
University of Pittsburgh 
3939 O'Har? Street 
Pittsburgh, PA 15213 

Dr. Jeff Richardson 
Executive Director 
Center for Applied AI 
Campus Box 419 
University of Colorado 
Boulder, CO 80309 

William kizzo 

Code 712 NAVTRAEQUIPCEN 

Orlando, PL 32813 

Dr. Andrew M. Rose 
American Institutes 

for Research 
1055 Thomas Jefferson St., NW 
Washington, DC 20007 



54 



Distribution List [CMU/Reder & Chamey] NR 667*529 



1986/02/14 



Dr. Ernst Z. Rothkopf 
AT&T Bell Laboratories 
Room 2D-456 
600 Mountain Avenue 
Murray Hill, NJ 07974 

Dr. William B. Rouse 

Georgia Institute of Technology 

School of Industrial & Systems 

Engineering 
Atlanta, GA 30332 

Ms. Riitta Ruotsalainen 
General Headquarters 
Training Section 
Military Psychology Office 
PL 919 

SF-00101 Helsinki 10, FINLAND 

Dr. Michael J. Samet 
Perceptronics, Inc 
6271 Variel Avenue 
Woodland Hills, CA 91364 

Dr. Robert Sasmor 
Army Research Institute 
50C Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Roger Schank 

Yale University 

Computer Science Department 

P.O. Box 2158 

New Haven, CT 06520 

Dr. Janet Schofield 
Learning R&D Center 
University of Pittsburgh 
Pittsburgh, PA 15260 

Dr. Marc Sebrechts 
Department of Psychology 
Wesleyan University 
Middletovn, CT 06475 

Dr. Judith Segal 
Room 819F 
NIB 

1200 19th Street N.W. 
Washington, DC 20208 



Dr. Robert J. Seidel 
US Army Research Institute 
5001 Eisenhower Ave. 
Alexandria, W 22333 

Dr. Ramsay W. Selden 
Assessment Center 
CCSS0 
Suite 379 

400 N. Capitol, NW 
Washington, DC 20001 

Dr. Sylvia A. S. Shafto 
National Institute of Education 
1200 19th. Street 
Mail Stop 1806 
Washington; DC 20208 

Dr. Lee Shulman 
Stanford University 
1040 Cathcart Way 
Stanford, CA 94305 

Dr. Zita M Simutis 
Instructional Technology 
Systems Area 

ARI 

5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. H. Wallace Sinaiko 
Manpower Research 

and Advisory Services 
Smithsonian Institution 
801 North Pitt Street 
Alexandria, VA. 22314 

Dr. Derek Sleeman 
Stanford University 
School of Education 
Stanford, CA 94305 

Dr. Edward E. Smith 
Bolt Beranek & Newman, Inc. 
50 Moulton Street 
Cambridge, MA 02138 

Dr. Elliot Soloway 

Tale University 

Computer Science Department 

P.O. Box 2158 

New Haven, CT 06520 



55 



Distribution Ust [CMU/Reder & Charney] NR 667*529 



1986/02/14 



Dr. Richard Sorensen 
Navy Personnel R&D Center 
San Diego, CA 92152 

Dr. Kathryn T. Spoehr 
Brown University 
Department of Psychology 
Providence, RI 02912 

Dr. Robert Sternberg 
Department of Psychology 
Yale University 
Box 11A, Yale Station 
Nfc*/ Haven, CT 06520 

Dr. Albert Stevens 
Bolt Beranek & Newman, Inc. 
10 Noulton St. 
Cambridge, HA 02238 

Dr. Paul J. Sticha 
Senior Staff Scientist 
Training Research Division 
HumRRO 

1100 S. Washington 
Alexandria, VA 22314 

Dr. Thomas Sticht 

Navy Personnel R&D Center 

San Diego, CA 92152 

Dr. Martin N. Taylor 

DCIEN 

Box 2000 

Downsview, Ontario 
CANADA 

Dr. David Thissen 
Department of Psychology 
University of Kansas 
Lawrence, KS 66044 

Dr. Douglas Towne 
Behavioral Technology Labs 
1845 S. Elena Ave. 
Redondo Beach, CA 90277 

Dr. Paul Twohig 
Army Research Institute 
5001 Eisenhower Avenue 
Alexandria, VA 22333 



Headquarters, U. S. Marine Corps 
Code MPI-20 
Washington, DC 20380 

Dr. Beth Varren 
Bolt Beranek & Newman, Inc. 
50 Moulton Street 
Cambridge, MA 02138 

Dr. Barbara White 
Bolt Beranek & Newman, Inc. 
10 Moulton Street 
Cambridge, MA 02238 

LCDR Cory deGroot Whitehead 
Chief of Naval Operations 
0P-112G1 

Washington, DC 20370-2000 

A. E. Winterbauer 
Research Associate 
Electronics Division 
Denver Research Institute 
University Park 
Denver, CO 80208-0454 

Dr. Robert A. Wisher 

U.S. Army Institute for the 

Behavioral and Social Sciences 
5001 Eisenhower Avenue 
Alexandria, VA 22333 

Dr. Martin F. Wiskoff 

Navy Personnel R&D Center 

San Diego, CA 92152 

Mr. John H. Wnlfo 

Navy Personnel R&D Center 

San Diego, CA 92152 

Dr. Wallace Wulfeck, III 
Navy Personnel R&D Center 
San Diego, CA 92152 

Dr. Jce Yasatuke 
AFHRL/LRT 

Lowry AFB, CO 80230 

Dr. Joseph L. Young 
Memory & Cognitive 

Processes 
National Science Foundation 
Washington, DC 20550 



56 



